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METHOD FOR ROBUST ASYMMETRIC MODULATION SPATIAL MARKING WITH SPATIAL 



Description 
Technical Domain 

The general domain concerns a signal and image processing technique that allows the hide data 
in an invisible way in digital (image, video, sound) or analogical (printed) media. 

A spatial digital marking with asymmetrical modulation is an extension of the classic digital 
watermarks. This extension allows, in particular, the covering of the printed media by offering a 
solution to print a digital spatial marking in an invisible way on a uniform colour media with visible 
colour inks. The application domain relates to the protection of printed documents and packaging 
against counterfeiting and falsification. 

State of the Art 

The known systems intended to prevent counterfeiting or alteration of printed or engraved 
documents can be classified into different groups: 

• holograms, the marks of special designs 

• marks with special inks or codes with invisible inks 

• chip or antenna systems 

Holograms, special designs and other decorations are difficult to reproduce since their production 
requires special equipment. They are specially designed to interfere with traditional photocopy 
systems so that the copy is visibly different to the original. These systems can be visually 
controlled without the aid of particular devices but they present the drawback of being expensive 
and they are well enough known by counterfeit specialists to be reproduced without problems and 
finally their visibility deserves the aesthetics of the protected object (perfume packaging for 
example). Their visibility is also the reason for their limited efficiency since a counterfeiter can 
easily identify the security element, either by copying the element or removing it physically. 

The marks with special inks use the particular chemical properties of the ink to provide a 
determined reaction to a particular action. Therefore, fluorescent inks become very bright when 
they are illuminated by a particular wavelength, certain inks are invisible in natural light while 
other inks change colour according to their orientation or temperature (and may be revealed by 
heating the paper with a finger), etc. In general, special inks are particularly expensive and for 
operation require modifications in the usual industrial production chain (supplementary mask for 
the offset, for example). Furthermore, although more difficult to counterfeit than the previous 
group, it is also possible to reproduce their effects insofar as a counterfeiter himself can control 
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the authenticity of his copy by making a comparison to the original since said counterfeiter 
disposes of the device that makes the inks react. 

The codes using invisible inks, unlike the two previous groups, allow the concealment of digital 
5 information. These codes can be characters, bars codes, 2D codes, etc. In addition to the high 
cost characteristic of invisible inks, this system has two major drawbacks. On one hand, due to 
the nature of the codes used, the system is located on a certain area of the document or 
packaging and it is thus possible to destroy it without altering the totality of the surface. On the 
other hand, the codes used always have geometric particularities (bars, geometrical figures, 
10 characters, etc) clearly identifying them as anti-copy devices. 

This greatly facilitates the task of the counterfeiter attempting to reveal and reproduce the ink. 
Furthermore, when the counterfeiter knows how to make this reproduction, he has in his 
possession ipso facto the means to reproduce the code. Finally, the systems based on 
embedded storage or processors accrue the drawbacks of being very expensive, unattractive and 
15 localised. Their main application consists more in securing communication or dynamically storing 
a piece of information rather than distinguishing an original from a copy. 

The digital watermark technique, also known under the name digital tattooing, is a technique that 
allows data concealment in a strong and imperceptible way in multimedia data such as music, 
20 video, images, documents, etc. The information that is concealed is called the signature. This 
signature can be, for example, a number, a name or an image. After the protection of the 
multimedia data with a digital watermark reference is made to a signed image, a signed video, 
etc. 

25 Numerous publications have been written on the different techniques allowing the concealment of 
a watermark in an image, in a video or an audio signal. With regard to the images, the latter can 
be classified according to the technique used for marking: certain techniques carry out 
modifications directly in the spatial domain (see for example [1] M. Kutter, F. Jordan, F. Bossen, 
"Digital watermaking of color images using amplitude modulation", Journal of Electronic Imaging, 

30 vol. 7, n° 2, pp. 326-332, April 1998.), others carry out these modifications in a transformed 
domain (for example the frequency domain) see intermediate domains such as wavelets (see [2] 
Shelby Pereira, Sviatoslav Voloshynovskiy and Thierry Pun, Optimized wavelet domain 
watermark embedding strategy using linear programming, In Harold H. Szu and Martin Vetterli 
eds., Wavelet Applications VII (part of SPIE AeroSense 2000), Orlando, Floride USA, April 26-28 

35 2000.). 



The process described in the patent number WO0225599 (priority CH20000001832 20000920) 
extends digital watermark technology to a printed media by means of an asymmetrical modulation 
of an independent signal of the underlying support and called in the following "spatial marking". 
Among the interests of this approach, the invisible printing on paper of uniform colour (white in 
5 particular), or the overlay on the printed matter (obtained by offset in particular) can be cited. The 
detection of this signal requires a digital scanner. A notable limitation of this approach is that the 
digital scanner must have at least the same resolution as that used to print the marking. This 
limitation, for example, is restrictive in the industrial domain because the high-speed scanners 
used to digitize the documents are incompatible with this invention. In fact, the high-speed 
10 scanners function at resolutions typically around 200 dpi, but a printed spatial marking at this 
same resolution of 200 dpi can be detected by the naked eye and copied with a photocopier. 

This invention describes a process to remove this constraint and thus allow the use of a low- 
resolution scanner (or any other optical acquisition method) to detect a high-resolution printed 
15 spatial marking. Therefore, it allows, for example, the printing of a spatial marking at 600 dpi 
(resolution compatible with industrial printers) and detection at 200 dpi (resolution compatible with 
industrial scanners). 

Brief Description of the invention 

20 A spatial marking is presented as an almost random scatter of points in spatial distribution. In the 
following, «printing resolution » is defined on the basis of the effective size of the spatial marking 
once printed in relation to its size in pixels, and not as the maximum resolution of points per unit 
of length that the printer can supply. 

25 For example, considering a spatial marking of 300 by 300 pixels, printed with a printer with 
resolution 1200 dpi. Supposing that the size obtained after printing was 1 inch by 1 inch. In this 
case, it is considered that the effective resolution of printing is 300 points per inch (or 300 dpi), 
and not 1200 dpi. 

30 In order to illustrate the critical character of the respective resolutions of printing and digitization, 
an example is given in the following for the particular case of the determination of the vertical 
positioning of two points. When the spatial marking is printed at a resolution of d points per unit of 
length, the size of the points has a diameter of approximately 1/d. A digitization of these points 
can be carried out with a scanner having a resolution d the size of printed points being identical 

35 to the digitizer resolution, it is possible distinguish said points (the base point is placed to thp 
right of the top point). In the case of a digitization carried out at a lower resolution (for example 
two times lower), the possibility of discrimination Is theoretically impossible. In this case, the 
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digitizer digitalizes both points as belonging to the same line. The two points are not distinguished 
and the scanner considers that it is in fact one point. 

The same reasoning is also valid for the horizontal resolution of the image. This limitation thus 
5 seems to be fundamentally intrinsic to spatial marking technology and up to now it has been 
accepted that the digitization resolution cannot under any circumstances be lower than that of 
printing. 

Nevertheless, the following process shows that such a possibility exists: a solution consisting in 
10 spacing out the points in order to compensate exactly the resolution difference between printing 
and digitization. In this case, supplementary blank lines have been inserted allowing a vertical 
spacing of the points of 2/d. 

The notable advantage of this invention is that it allows the detection of a spatial marking with 
15 numerous systems based on low-resolution digital scanners. This is the case in particular with 
high-speed digitizers used for paper documents (cheques, bank transfers, etc.) but also for 
certain card readers. 

The relationship between the printing resolution and the reading resolution is typically comprised 
20 between 2 and 5. 

Another advantage of the system is that it allows the increase of the invisibility of the spatial 
marking by using the two following phenomenon: 
• Point size reduction 
25 • Reduction of the concentration of points per printed surface unit 

These parameters are mathematically quantified below. 
List of Drawings 

30 Figure 1 : Representation of the signal and area digitized by a scanner with a resolution two times 
lower than the size of the points. 

Figure 2: Representation of the signal and area digitized by a scanner with a resolution identical 
to the size of the points. 

Figure 3: Use of a digitization resolution lower than that of printing. 
35 Figure 4: Illustration of the change of spacing for the vertical and horizontal dimension. 

Figure 5: Diagram of the process allowing the obtainment of a sub-sampled and eroded spatial 
marking. 
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Figure 6: Diagram of the implementation of the spatial marking modified by printing and detection. 

Figure 7: Illustration of the of sub-sampling and erosion function 

Figure 8: Representation of the acquisition by a scanner of a spatial marking 

Figure 9: Illustration of an auto-correlated spatial marking 

5 

Detailed Description of the invention 

Figure 1 shows a band of a scanner with a resolution lower than the resolution of the points PC 
applied on this band LN. The scanner is active on a band LN with a resolution 2/d or half lower 
than the printing resolution 1/d. 

10 

In Figure 2, the scanner is of a resolution 1/d equivalent to the printing resolution. 

The reading of the first line LN1 and the second line LN2 allows the detection without problem of 

the points PC of this spatial marking. 

15 Figure 3 shows a printed spatial marking with a resolution 1/d (the resolution of points PC). The 
size of the point PC is half lower than the width of the acquisition band 2/d of a scanner. 

Figure 4 shows the printing result of a spatial marking, Figure 4a being the spatial marking base 
and Figure 4b being the printed spatial marking. Both spatial markings have an identical number 
20 of points. This example is based on a printing ratio on the resolution of the scanner of 3. It is 
noted that the surface used by the spatial marking base 4a is 3 times smaller than the printed 
spatial marking 4b. At the same time, each printed point is spaced at a minimum of 2 non-printed 
points. 

25 An embodiment method of the invention is based on a post-processing procedure of a spatial 
marking image illustrated by the diagram in Figure 5. A standard spatial marking of almost 
random distribution with a size XxY is first generated. The latter is then sub-sampled in a binary 
way with a factor n in its horizontal and vertical dimensions by a first module ST1 . The result is a 
spatial marking CR with a size NX x A// whose points, in particular, encoding the signal - carriers 

30 of the redundant information - henceforth have a size of NxN. This image is then reprocessed by 
means of an erosive filter ST2 leading again to some points with a size of 1x1 but in an image 
always forming NX x NY. This process is thus qualified as « erosive sub-sampling ». 

The implementation of the printing and detection of the spatial marking obtained in this way is 
35 shown in Figure 6. In a first step PRT, the spatial marking CR' (NX x NY) is first printed with a 
resolution 61. The printed support obtained in this way is subsequently digitized in the module 
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SCN with a resolution 62. As previously mentioned, the object of this invention is precisely that 
d2<d1. 

There is a ratio mathematically connecting the post-processing procedure with the 
implementation of spatial marking. 
The latter is given by: 



For example, a spatial marking can be printed with a resolution of d1=300 dpi and scanned with a 
resolution of d2=100 dpi. In this case, the ratio of the resolutions is n=3, which means that the 
number of horizontal and vertical points defining the printed spatial marking CR' is 3 times higher 
then that obtained after digitization. 

Digitalization with a resolution d2of the post-treated spatial marking leads to a contrast reduction 
between the digitized points and the background that depends on the ratio n. The final colour c'of 
the digitized point can be calculated: considering bthe background colour and cthe colours of the 
points of the spatial marking (both comprised between 0 and 1). c' is then calculated taking 
account the fact that there is only one colour c and n 2 -1 points in colour b: 



In the particular case of a black signal c = 0 on a white background b=*\, it can be ascertained 
that c' > c, and that this average colour is similar to that of the background (b=1), especially when 
n is large. The contrast of the signal in relation to the background is thus decreased, which 
increases the invisibility at the same time as the noise signal ratio that characterizes the clarity of 
the spatial marking in relation to the support on which it is printed. For example, for n=3, a black 
signal c=0 on a white background b=1, the colour of the digitized point will be c=0.88. This 
corresponds to a contrast decrease with the background colour of 88% in relation to the initial 
colour of the black point. 

The method described above can be applied to the case of an anisotropic processing of spatial 
marking. In this case, the resolutions used for digitization and printing are different according to 
the directions x and y. As this method acts independently on each of these directions, it can be 
applied directly. The ratios are then applied by considering the resolution according to the 
directions x and y used for printing (resp. d1x and d1y) and those used for digitization (resp. d2x 
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and d2y) giving the erosive sub-sampling factor according to the directions x and y, respectively 



5 These factors are in particular applicable in the case of industrial jet ink printers where the 
scrolling speed of the paper is susceptible to create a different resolution in the two sizes, a 
similar effect can also be observed on a scanner. 

Figure 7 shows the preparation process of a spatial marking according to the invention. 



Figure 7a shows the spatial marking base with a resolution d. The first stage is the stage of sub- 
sampling according to the resolution on the scanner. According to the example illustrated in 
Figure 7b, the resolution in x is four times (n) lower and the resolution in y is three times (m) lower 
than that of printing. 



To illustrate the erosion process, Figure 7c shows an alternative that consists of choosing only 
one of the points according to its position. Therefore, according to this example, the retained point 
is that which is low down and to the left. The resulting spatial marking necessarily includes 
spaced points so that only one point is taken during an acquisition at the maximum resolution of 
20 the scanner. 

The processing of the scanner is disclosed in Figure 8. Its functioning is essentially asynchronous 
and each acquisition area does not correspond inevitably with the division of the spatial marking 
during printing. An acquisition area is illustrated by a dotted line. It can be observed that for a 
25 given area, only one spatial marking point remains which authorizes effective processing. 

Genera! Concept of Spatial Marking 

The design of spatial marking comes down to which points must be printed and which must be 
allowed to appear on the background of the document. This concept takes into account the 
30 method used for decoding. 



nx and ny. 
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The decoding of the spatial marking requires the use of its autocorrelation, intercorrelation and 
statistical correlation properties with the encoded data respectively to compensate the affine 
geometrical transformations, the translations and the possible noise of the signal. The 
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autocorrelation and correlation properties are defined at the time of the conception of the spatial 
marking and must take into account the level of sub-sampling desired. At the theoretic level, the 
points encode a binary piece of information according to a spectrum display process and these 
points are also selected so that the image obtained has autocorrelation properties (see for 
5 example M. Kutter, F. Jordan, F. Bossen, "Digital watermaking of color images using amplitude 
modulation", Journal of Electronic Imaging, vol. 7, n° 2, pp. 326-332, April 1998). The paragraphs 
below describe an embodiment of a conception method of a correlated spatial marking to a binary 
piece of information and an autocorrelated spatial marking. 

10 Conception of a Correlated Spatial Marking with a Binary Piece of Information 

Taken / ={-1,1} the value of a bit to be encoded. Taken {x,y} a group of pseudo randomly chosen 
points (on the base of a key) among all the points of the image X x Y and k an index identifying 
each of the coordinates {x,y} of these points. Taken a(k) a pseudo random generator defined by a 
second key and giving the values { -1,1}. Taken v, a colour comprised between 0 (black/colour) 
15 and 1 (white). Either c(k) the final colours of the point k of the spatial marking. The following 
formula is then applied: 

If i.a(k) > 0 then c(k) = V if not c(k) = 1 

For example, if only one bit is encoded with v varying from 0 to 99, a spatial marking colour v=0, 
20 and a(k) =k module 2, this means that the image of the spatial marking will be composed of 50 
black points and 50 white points, all the other points of the spatial marking remaining white. 
These points encode this bit with a redundancy of 100. 

Conception of an Autocorrelated Spatial Marking 

25 A method allowing a spatial marking to be obtained presenting an autocorrelation property 
consists in conceiving the digital image of the spatial marking by duplicating the group of points { 
x,y\ 4 times. This duplication can be carried out by translating the group of points according to 4 
vectors defined by (0,0), (0, s), (S,0), (S,S) where S defines the translation distance. It is possible 
to carry out this duplication using the following method: 

30 o Selection of a group of points { x,y\ so that the coordinates (x,y) are pairs 

o Selection of an uneven translation distance S 

o Creation of the spatial marking with the 4 groups of points { x,y}, { x+S,y}, {x,y+S}, { 
x+S,y+S} 

This method guarantees that any of the points of the 4 groups do not superpose. 

35 

Figure 9 shows this approach with a group { x,y} comprising 2 points and a translation S=3. 
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During this operation, certain points are capable of having coordinates outside the size of the 
image of the spatial marking XxY. One method consists in carrying out the translation by using a 
modulo on the size of the image. The following formulas illustrate the module method for the 
horizontal coordinate x: 
5 { x+S} = x+S if x+S < X 
{ x+S} = x+S-X if x+S > X 

The same principle is applied to the coordinate y. 

Autocorrelation introduced in this way is used to compensate an affine type geometric 
10 transformation possibly produced by the digital acquisition of the spatial marking. Thus x,y are the 
coordinates of a point of the cryptoglyph before printing and x\y' are the coordinates of this point 
after digitization, the affine relation between these coordinates is written: 

V = ax + by 

y 1 = cx + dy 

Once the coefficients (a,b,c,d) are determined from the position of the autocorrelation figure, it is 
15 thus possible to establish the original coordinates (x,y) by compensating the geometric 
transformation induced by the digital acquisition. 

Conception of a Strong Spatial Marking for Sub-Sampling 

In the particular case of this invention, the decoding of the signal is made difficult because the 
20 sub-sampling produced by low-resolution digitization entails a reduction of contrasts between the 
points and the background colour, this contrast reducing further with the square of n. Two 
solutions are used to compensate this reduction of the noise signal ratio: 

o Increase of encoding redundancy 
For one image of the size XxY, encoding redundancy is defined by the following formula: 

b 

wherein the density p, comprised between 0 and 1 , defines the ratio of printed points in relation 
to the size of the image in pixels, and b defines the number of encoded bits. Therefore, if one 
considers the image of spatial marking with the size 100 by 100 pixels with a density of 0.1 and 
10 encoded bits, a redundancy of 100 is obtained. 

30 

o Increase of contrasts between the point colour and the background colour 
For that it is necessary to choose an ink colour c which maximises the absolute value \c-b\. 

These two solutions can be used separately or simultaneously. They are implemented 
35 empirically, knowing that: 
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Beyond a certain threshold that depends among other things on printing colour, on printing 
support and on printing resolution, it is not possible to increase simultaneously the density and 
contrast because the spatial marking becomes visible. 

5 

The redundancy value cannot decrease under a certain threshold that depends on alterations that 
the printed support is capable of undergoing, without this decoding errors may occur. 

Implementation of the Spatial Marking Properties for the Detection Process 

10 The properties of the spatial marking defined previously allow the execution of a reliable decoding 
that develops according to the following steps 

digital acquisition of an image of the support, 

filtering on the obtained image to eliminate the parts not comprising the spatial marking. This 
15 filtering can take into account the characteristics of a graphic possibly printed on the support. 

It can be carried out by using a compensation based on a uniform colour or by means of a 
prediction of the colours of the support before printing of the graphic. This type of prediction 
can be made by a soundproofing filter (of the Wiener type, for example), 
use of the autocorrelation properties to compensate every affine transformation introduced 
20 by the acquisition, as well as previously described. 

compensation in translation of the spatial marking using an intercorrelation between the 
spatial marking obtained and the group of possible positions of the spatial marking defined 
by a key, 

decoding of the digital information by statistical correlation for each bit of the information. 

25 

Other Marking Processes 

In the foregoing there is essentially the process of marking by printing that has been cited. 
However, all processes that lead to obtaining a point that can be distinguished in relation to a 
background can be used. For example, and in a non- exhaustive way, engraving by laser of 
30 points on a glass surface to conceal an invisible code can be cited. It is also possible to use 
points presenting the magnetic particularities different to those of the background. 

Other Acquisition Processes 

This invention can be directly applied to the detection of non-optical properties of points (electric, 
35 magnetic, position in depth/height). The digital acquisition process of the spatial marking of a 
surface (product or document) can also be completely dissociated from the digital processing 
procedure thus allowing the detection of this marking. For example, it is possible to photograph 
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digitally a marked surface and send the image on a network to a remote computer that carries out 
the detection. The result of this detection can also be sent again to the operator. The 
development of mobile telephones disposing of a low-resolution camera makes the process of the 
invention very attractive. 



